Estimating Information-Theoretic Quantities

Definition Information theory is a practical and theoretical framework developed for the study of communication over noisy BLOCKIN BLOCKIN channels. BLOCKIN BLOCKIN Its BLOCKIN BLOCKIN probabilistic BLOCKIN BLOCKIN basis BLOCKIN BLOCKIN and BLOCKIN BLOCKIN capacity BLOCKIN BLOCKIN to BLOCKIN BLOCKIN relate BLOCKIN BLOCKIN statistical BLOCKIN BLOCKIN structure BLOCKIN BLOCKIN to BLOCKIN BLOCKIN function BLOCKIN BLOCKIN make BLOCKIN BLOCKIN it BLOCKIN BLOCKIN ideally suited for studying information flow in the nervous system. It has a number of useful properties: it is a general measure sensitive to any relationship, not only linear effects; it has meaningful units which in many cases allow direct comparison between different experiments; and it can be used to study how much information can be gained by observing neural responses in single trials, rather than in averages over multiple trials. A variety of information theoretic quantities are in common use in neuroscience – (see entry " Summary BLOCKIN BLOCKIN of BLOCKIN BLOCKIN Information-­‐Theoretic BLOCKIN BLOCKIN Quantities "). BLOCKIN BLOCKIN Estimating BLOCKIN BLOCKIN these BLOCKIN BLOCKIN quantities BLOCKIN BLOCKIN in BLOCKIN BLOCKIN an BLOCKIN BLOCKIN accurate BLOCKIN BLOCKIN and BLOCKIN BLOCKIN unbiased way from real neurophysiological data frequently presents challenges, which are explained in this entry.